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Abstract The problem of maximizing non-negative monotone submodular 
functions under a certain constraint has been intensively studied in the last 
decade. In this paper, we address the problem for functions defined over the 
integer lattice. 

Suppose that a non-negative monotone submodular function / : Z™ —>- R+ 
is given via an evaluation oracle. Assume further that / satisfies the diminish¬ 
ing return property, which is not an immediate consequence of submodularity 
when the domain is the integer lattice. Given this, we design polynomial-time 
(1 — 1/e — e)-approximation algorithms for a cardinality constraint, a polyma- 
troid constraint, and a knapsack constraint. For a cardinality constraint, we 
also provide a (1 — 1/e — e)-approximation algorithm with slightly worse time 
complexity that does not rely on the diminishing return property. 

Keywords submodular functions • integer lattice • DR-submodular functions 


1 Introduction 

Submodular functions have been intensively studied in various areas of op¬ 
erations research and computer science, as submodularity naturally arises in 
many problems in these fields [12,14,18]. In the last decade, the maximization 
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of submodular functions in particular has attracted interest. For example, one 
can find novel applications of submodular function maximization in the dis¬ 
semination of influence through social networks [17], text summarization [19, 
20], and optimal budget allocation for advertisements [1]. 

Most past works in the area have considered submodular functions de¬ 
fined over a set—submodular functions which take a subset of a ground set 
as the input and return a real value. However, in many practical scenar¬ 
ios, it is more natural to consider submodular functions over a multiset or, 
equivalently, submodular functions over the integer lattice 7L E for some fi¬ 
nite set E. We say that a function / : Z E —>• M is (lattice) submodular if 
f{x) + f{y) > f(x V y) + f(x A y) for all x, y £ Z E , where x V y and x Ay 
denote the coordinate-wise maximum and minimum, respectively. Such a gen¬ 
eralized form of submodularity arises in maximizing the spread of influence 
with partial incentives [9], optimal budget allocation, sensor placement, and 
text summarization [26]. 

When designing algorithms for maximizing submodular functions, the di¬ 
minishing return property often plays a crucial role. A set function / : 2 E —>• R 
is said to satisfy the diminishing return property if f(X + e) — f(X) > 
f(Y + e) — f(Y) for all X C Y C E and e ^ Y. For example, the simple 
greedy algorithm for cardinality constraints proposed by Nemhauser et al. [22] 
works because of this property. For set functions, it is well-known that submod¬ 
ularity is equivalent to the diminishing return property. For functions over the 
integer lattice, however, lattice submodularity only implies a weaker variant 
of the inequality. This causes difficulty in designing approximation algorithms; 
even for a single cardinality constraint, we need a more complicated approach 
such as partial enumeration [1,26]. 

Fortunately, objective functions appearing in practical applications admit 
the diminishing return property in the following sense. We say that a function 
/ : Z B -> R is diminishing return submodular (DR-submodular) if f(x + 
Xe) ~ /(*) > f(y + X e ) - f{y) for arbitrary x < y and e e E, where x e 
is the i-th unit vector. Any DR-submodular function is lattice submodular; 
i.e., DR-submodularity is stronger than lattice submodularity. 1 The problem 
of maximizing DR-submodular functions over Z E naturally appears in the 
submodular welfare problem [16,24] and the budget allocation problem with 
decreasing influence probabilities [26]. Nevertheless, only a few studies have 
considered this problem. In fact, it was not known whether we (1 — 1/e)- 
approximation can be obtained in polynomial time under a single cardinality 
constraint. 


1 Note that / is DR-submodular if and only if it is lattice submodular and satisfies the 
coordinate-wise concave condition : f(x + Xe) — f{ x ) > f( x + 2x e ) — f( x + Xe) f° r an y * 
and e £ E (see [27, Lemma 2.3]). 
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1.1 Main Results 


In this paper, we develop polynomial-time approximation algorithms for max¬ 
imizing monotone DR-submodular functions under cardinality constraints, 
polymatroid constraints, and knapsack constraints. Let / : 7L E -i R be a 
non-negative monotone DR-submodular function unless explicitly stated oth¬ 
erwise. Then given any small constant e > 0, our algorithms find (1 — 1/e — e)- 
approximate solutions under these constraints. The details are described be¬ 
low. 


Cardinality Constraint: The objective is to maximize f(x) subject to 0 < x < 
c and x{E) < r, where c G Z+, r G Z + , and x(E) = x ( e )- We design 

a deterministic approximation algorithm with 0(^ log HcHoq log -) running 
time, which is the first polynomial time algorithm for this problem. 

Cardinality Constraint (lattice submodular case): For cardinality constraints, 
we also show a (1 — 1/e — e)-approximation algorithm for a monotone lattice 
submodular function /. This algorithm runs in 0(^ log HcHoo log | logr) 
time, where r is the ratio of the maximum value of / to the minimum 
positive increase in the value of /. 

Polymatroid Constraint: The objective is to maximize f(x) subject to x G 
P n Z+, where P is a polymatroid given via an independence oracle. Our 


algorithm runs in 0 (" 5 - log 2 r + n s ) time, where r is the maximum value of 
x(E) for x G P. This is the first polynomial time (1—1/e—e)-approximation 
algorithm for this problem. 

Knapsack Constraint: The objective is to maximize f(x) subject to 0 < x < c 
and a single knapsack constraint w T x < 1, where w G (0, lp. We devise an 


approximation algorithm with O 


(^log 3 


log 


+ f log I 


.log- 


running time, where r is the ratio of the maximum value of / to the min¬ 
imum positive increase in the value of /, and u> m i n is the minimum entry 
of w. This is the first polynomial time algorithm for this problem. 


1.2 Technical Contribution 

In order to devise polynomial-time algorithms instead of pseudo-polynomial 
time algorithms, we need to combine several techniques carefully. Our algo¬ 
rithms adapt the “decreasing-threshold greedy” framework recently introduced 
by Badanidiyuru and Vondrak [2], and work in the following way. We main¬ 
tain a feasible solution x G and a threshold 9 G M during the algorithm. 
Starting from x = 0 , we greedily increase each component of x if the average 
gain in the increase is above the threshold 0, with consideration of constraints. 
Slightly decreasing the threshold 0, we repeat this greedy process until 9 be¬ 
comes sufficiently small. We combine this framework with pseudo-polynomial 
time greedy algorithms to design a polynomial time algorithm for cardinality 
constraints. We also need to incorporate the partial enumeration technique [26, 
29] to obtain a polynomial time algorithm for knapsack constraints. In order 
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to develop a polynomial time algorithm for polymatroid constraints, we fol¬ 
low the continuous greedy approach [7]; instead of the discrete problem, we 
consider the problem of maximizing a continuous extension of the original 
objective function. After the greedy phase, we round the current fractional 
solution to an integral solution if needed. 

As described above, our algorithms share some ideas with the algorithms 
of [2,7,26,29]. However, we attain several improvements and introduce new 
ideas, mainly due to the essential difference between set functions and func¬ 
tions over the integer lattice. 

Binary Search in the Greedy Phase: In most previous algorithms, the greedy 
step works as follows: find the direction of the maximum marginal gain 
and move the current solution along this direction with a unit step size. 
However, it turns out that a naive adaptation of this greedy strategy only 
yields a pseudo-polynomial time algorithm. To circumvent this issue, we 
perform a binary search to determine the step size in the greedy phase. 
Combined with the decreasing threshold framework, this technique signif¬ 
icantly reduces the time complexity. 

New Continuous Extension: To execute the continuous greedy algorithm, we 
need a continuous extension of functions over the integer lattice. Note that 
the multilinear extension [6] cannot be directly used because the domain 
of the multilinear extension is only the hypercube [0, 1] E . In this paper, we 
propose a new continuous extension of a function over the integer lattice for 
polymatroid constraints. This continuous extension has similar properties 
to the multilinear extension when / is DR-submodular, and is carefully de¬ 
signed so that we can round fractional solutions without violating polyma¬ 
troid constraints. To the best of our knowledge, this continuous extension 
in Rf has not been proposed in the literature so far. 

Rounding without violating polymatroid constraints: Rounding fractional so¬ 
lutions in R+ without violating polymatroid constraints is non-trivial. We 
show that the rounding can be reduced to rounding in a matroid polytope; 
therefore we can use existing rounding methods for a matroid polytope. 

Modification to the conference version An extended abstract of this paper 
appeared in [28]. Unfortunately, the algorithm for a knapsack constraint pre¬ 
sented there is quite complicated and has a technical flaw: the correct time 
complexity is not as stated. In this paper, we provide another much simpler 
algorithm for a knapsack constraint. A main difference is that the algorithm 
in this paper use partial enumeration, whereas the algorithm in [28] used con¬ 
tinuous greedy. 


1.3 Related Work 

Studies on maximizing monotone submodular functions were pioneered by 
Neumhauser, Wolsey, and Fisher [22]. They showed that a greedy algorithm 
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achieves a (1 — l/e)-approximation for maximizing a monotone and submodu¬ 
lar set function under a cardinality constraint, and a 1/2-approximation under 
a matroid constraint. Their algorithm provided a prototype for subsequent 
work. For knapsack constraints, Sviridenko [29] devised the first (1 — 1/e)- 
approximation algorithm with 0(n 5 ) running time. Whereas these algorithms 
are combinatorial and deterministic, the best known algorithms for matroid 
constraints are based on a continuous and randomized method. The first 
(1 — l/e)-approximation algorithm for a matroid constraint was provided by 
[6], and employed the continuous greedy approach: first solve a continuous 
relaxation problem and obtain a fractional approximate solution; then round 
it to an integral feasible solution. In their framework, the multilinear exten¬ 
sion of a submodular set function was used as the objective function in the 
relaxation problem. They also provided the pipage rounding to obtain an inte¬ 
gral feasible solution. Chekuri, Vondrak, and Zenklusen [7] designed a simple 
rounding method— swap rounding —based on the exchange property of ma¬ 
troid base families. Badanidiyuru and Vondrak [2] recently devised (1 —1/e—e)- 
approximation algorithms for any fixed constraint e > 0, with significantly 
lower time complexity for various constraints. For the inapproximability side, 
Nemhauser et al. [22] proved that no algorithm making polynomially many 
queries to a value oracle of / can achieve an approximation ratio better than 
1 — 1/e under any of the constraints mentioned so far. Furthermore, Feige [10] 
showed that, even if / is given explicitly, (1 — l/e)-approximation is the best 
possible unless P = NP. 

Generalized forms of submodularity have been studied in various contexts. 
Fujishige [12] discussed submodular functions over a distributive lattice and 
its related polyhedra. In the theory of discrete convex analysis by Murota [21], 
a subclass of submodular functions over the integer lattice was considered. 
The maximization problem has also been studied for variants of submodu¬ 
lar functions. Shioura [24] investigated the maximization of discrete convex 
functions. Soma et al. [26] provided a (1 — l/e)-approximation algorithm for 
maximizing a monotone lattice submodular function under a knapsack con¬ 
straint. However, its running time is pseudo-polynomial. Although this paper 
focuses on monotone submodular functions, there is a large body of work on 
maximization of non-monotone submodular functions [11,4,5,3]. Gottschalk 
and Peis [13] provided a 1/3-approximation algorithm for maximizing a lattice 
submodular function over a (bounded) integer lattice. Recently, bisubmodular 
functions and k-submodular functions, other generalizations of submodular 
functions, have been studied as well, and approximation algorithms for maxi¬ 
mizing these functions can be found in [15,25,30]. 


1.4 Organization of This Paper 

The rest of this paper is organized as follows. In Section 2, we provide our 
notations and basic facts on submodular functions and polymatroids. Section 3 
describes our algorithm for cardinality constraints. In Section 4, we provide 
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the continuous extension for polymatroid constraints and our approximate 
algorithm. We present our algorithm for knapsack constraints in Section 5. 


2 Preliminaries 

Notation We denote the sets of non-negative integers and non-negative reals 
by Z + and R+, respectively. We denote the set of positive integers by N. For a 
positive integer k £ N, [k] denotes the set {1,..., k}. Throughout this paper, E 
denotes a ground set of size n. We denote the z-th entry of a vector x £ R" by 
x(i). The z-th standard unit vector is denoted by Xi • The zero vector is denoted 
by 0 and the all-one vector by 1. We denote the characteristic vector oi X C E 
by Xx- Tor / : R B —> R and x, y £ R E , we define f(x \ y) := f(x + y) — f(y). 
For x £ M. E and X C E, we denote x(X) := x (i)- For a vector x £ R B , 

supp + (:c) denotes the set {e £ E \ x(e) > 0}. For x £ Z E , {x} denotes the 
multiset where the element e appears x{e) times. For arbitrary two multisets 
{a:} and {y}, we define {a;} \ {y} := {{x — y) V 0}. For a multiset {a;}, we 
define |{a;}| := x(E). We often denote an optimal solution and the optimal 
value by x* and OPT, respectively. 

For an error parameter e > 0, we always assume that j- is an integer 
(otherwise we can slightly reduce it without changing the asymptotic time 
complexity and the approximation ratio). 

We frequently use the following form of ChernofFs bound. 

Lemma 1 (Relative+Additive Chernoff’s bound, [2]) Let Xi,...,X m 
be independent random variables such that for each i, Xf £ [0,1]. Let X = 
T J2 Xi and fi = E[X]. Then 

Pr[X > (1 + a)y + j3\ < e ^, 

Pr[A' < (1 — a)y — /3] < e ^. 

2.1 Submodularity and the Diminishing Return Property 

We say that a function / : Z E —>• R is lattice submodular if it satisfies f(x) + 
f(y) > f{x V y) + f(x A y) for all x, y £ Z E , where x V y and x Ay denote 
the coordinate-wise maximum and minimum, respectively, i.e., (x V y)(e) = 
max{s(e), y(e)} and (x A y)(e) = min{cc(e), y(e)} for each e £ E. A function 
/ : Z® -t R is monotone if f(x) < f(y) for all x and y with x < y. We 
say that / : Z E -A R is diminishing return submodular (DR-submodular) if 
f( x + Xi) - f( x ) > f(y + Xi) - f(y) for every x < y and i £ E, where 
Xi denotes the z-th unit vector. We note that the lattice submodularity of 
/ does not imply DR-submodularity when the domain is the integer lattice. 
Throughout this paper, we assume that /(0) = 0 without loss of generality. 

If a function / : Z E -A R satisfies f(x V kxf) - f( x ) > f(y V kxf) - f(y) 
for any i £ E, k £ Z+, x and y with x < y, then we say that / satisfies the 
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weak diminishing return property. Any monotone lattice submodular function 
satisfies the weak diminishing return property [26]. 


2.2 Polymatroid 

Let p : 2 e —» Z + be a monotone submodular set function with p(0) = 0. 
The (integral) polymatroid associated with p is the polytope P = {x G : 
x(X) < p(X) \/X C E}, and p is called the rank function of P. The base 
polytope of polymatroid P is defined as B := {x G P : x{E ) = p(E)}. The set 
of integral points in B satisfies the following simultaneous exchange property: 

For any x, y G Br |Z+ and s G supp + (cc — y), there exists t G supp + (y— 
x) such that x - x s + Xt G B PI Zf and y + * s - Xt e B n Zf. 

The following lemma can be derived by the simultaneous exchange prop¬ 
erty. 

Lemma 2 Let x,y G B 0 Z-f and I(x) := {(e,i) : e G supp + (:r),l < 
i < x(e)}. Then there exists a map <f> : I(x) supp + (y) such that x — 
Xe + Xp{e,i) G B l~l Zf for each e G supp + (a;) and 1 < i < x(e), and 
Ik Xc/)(e,i) * 

Proof Induction on |{a;} \ {y}|. If |{®} \ {y}\ = 0, then <j>{e,i) := e satisfies 
the condition. Let us assume that |{a:} \ {y}\ > 0. Let us fix s G supp + (cc — y) 
arbitrarily. By the simultaneous exchange property, we can find t G supp + (y — 
x) such that x - x s + Xt G B n Zf and y' := y + - Xt G B (~l Zf. By 

the induction hypothesis, we can obtain <f>' : I{x) —> supp + (y') satisfying the 
conditions. The desired <\> can be obtained by modifying <j>' as y(s) + 1) := 
t. □ 


3 Cardinality Constraint 

In this section, we consider cardinality constraints. We provide approximation 
algorithms for maximizing monotone DR-submodular and lattice submodular 
functions in Sections 3.1 and 3.2, respectively. 


3.1 Maximization of Monotone DR-Submodular Function 

We start with the case of a DR-submodular function. Let / : Zf_ —»• R + be 
a monotone DR-submodular function. Let c G Zf_ and r G Z+. We want to 
maximize f(x) under constraints 0 < x < c and x(E) < r. The pseudocode 
description of our algorithm, based on the decreasing threshold greedy frame¬ 
work, is shown in Algorithm 1. 
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Algorithm 1 Cardinality Constraint/DR-Submodular 
Input: / : Z+ —> M_|_, c E Z+, r E Z+, and e > 0. 

Output: y E Z^. 

1: u •<— 0 and d «— ma x e ^E 

2: for = do 

3: for all e E E do 

4: Find maximum k < min{c(e) — y(e),r — y(E)} with f(k\ e \ y) > kQ with binary 

search. 

5: if such k exists then 

6: y<-3/ + fcx e - 

7: return y. 


Lemma 3 Let x* be an optimal solution. When we are adding k\ e t° 
current solution y in Line 6, the average gain satisfies the following: 


fjkXe I y) 
k 


J2 fix. I y)- 

s£{x*}\{y} 


Proof Due to DR-submodularity, the marginal values can only decrease as we 
add elements. When we are adding a vector k\ e and the current threshold 
value is 6 1 the following inequalities hold: 

Claim f{kx e \ y) > k6, and f(x s \ y) < for any s £ {a;*} \ {y}. 

Proof The first inequality is trivial. The second inequality is also trivial by 
DR-submodularity if 9 = d. Thus we assume that 6 < d, i.e., there was at 
least one threshold update. Let s £ {x*} \ {y}, k 1 be the increment in the 
s-th entry in the previous threshold (i.e., jzr), and y' be the variable y at 
the time. Suppose that f(x s \ y) > Then f((k' + l)x s | y') > f(x s I 
y) + f{k'x s I v') > , which contradicts the fact that k! is 

the largest value with f(k'x s I 2/0 > □ 


The above inequalities imply that > (1 — e)f(x s I 2/) f° r e& ch 

s £ {a:*} \ {y}. Taking the average over these inequalities we obtain 


fi k X e I v) 


> 


1 - e 


IM\MI 


55 fix. I y ) > 


1 - e 


s£{a;*}\{y} 


fix. 

s£{a;*}\{3/} 


y) 


□ 


Theorem 1 Algorithm 1 achieves an approximation ratio of 1 — - — e in 
0(j log ||c||oo log |) time. 

Proof Let y be the output of Algorithm 1. Without loss of generality, we can 
assume that y(E) = r. To see this, consider a modified version of the algorithm 
in which the threshold is updated until y(E) = r. Let y' be the output of this 
modified algorithm. Since the marginal gain of increasing any coordinate of y 
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Algorithm 2 BinarySearchLattice(/, e, 6 , /c max , e) 

Input: / : Z+ -> R+, e G 0 > 0, /c m ax E Z+, e > 0. 

Output: 0 < k < fc m ax or fail. 

1: Find /c m i n with 0 < k m i n < k max such that f(k m i n X e ) > 0 by binary search. 

2: if no such fc m i n exists then fail. 

3: for (h = /(fc max X e ); h > (1 - e)f{k min x e ); h = (1 - e)h) do 

4: Find the smallest k with k m i n < k < fc max such that f(kx e ) ^ h by binary search. 

5: if f{kx e ) (1 — e)k0 then 

6: return fc. 

7: fail. 


by one is at most e^, f(y') — f{y) < ed < eOPT. Therefore, it suffices to show 
that y' is a (1 — 1/e — e)-approximate solution. 

Let y t be the vector y following the i-tli update. We define y 0 = 0. Let 
kiXei the vector added during the i -th update. That is, y i = kjX ej - 

By Lemma 3, for any i £ N, 


f(kiXe z I Vi- 1) 

ki 


/(*» 


Vi-l)- 


By DR-submodularity, f(x s I Vi-l) > f( x * v Vi-i) ~ fiVi-i) 

holds. Therefore by monotonicity, 

f(Vi) ~ f(Vi- 1) = f (kiX ei I Vi-i) 

> ——V yi_r) - f(Vi-i)) 

r 

> (1 ~ £)fci (OPT -fiVi^)). 

Hence, we can show by induction that f(y) > ^1 — JJ, (l — OPT. 

Since U t (l - (1 ~r )ki ) < 11; exp = exp (- (1 ~ e) r Ei ki ) = e~^ < 

\ + e, we obtain (1 — - — e)-approximation. □ 


3.2 Maximization of Monotone Lattice Submodular Function 

We now consider the case of a lattice submodular function. Let / : —»• 
R+ be a monotone lattice submodular function, c G Z^, and r G Z+. We want 
to maximize f(x) under the constraints 0 < x < c and x(E ) < r. 

The main issue is that we cannot find k such that f(kx e \ x) > kO by 
naive binary search. However, we can find k such that f{kx e | as) > (1 — e)kd 
in polynomial time (if exists). The key idea is guessing the value of f{kx e ) by 
iteratively decreasing the threshold and checking whether the desired k exists 
with binary search. See Algorithm 2 for details. 

We have the following properties: 

Lemma 4 Algorithm 2 satisfies the following: 
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Algorithm 3 Cardinality Constraint/Lattice Submodular 

Input: / : —> K+, c G Z+, r G Z+, e > 0. 

1: V «- o and d max G- max eS£ ; /(c(e)x e ). 

2: for (0 = d max ; 0 > t«f m ax; 0 «- 0(1 — e)) do 
3: for all e G E do 

4: Invoke BinarySearchLattice(/(- | y), e, 0, min{c(e) — j/(e), r — y(E)}, e) 

5: if BinarySearchLattice did not fail and returned k G N then 

6: y-s-i/ + fcx e - 

7: return y. 


(1) Suppose that there exists 0 < k* < fc max such that f{k*x e ) > k*9. Then, 
Algorithm 2 returns k with k m - ln < k < fc max such that f{kx e ) > (1 — e)kd. 

(2) Suppose that Algorithm 2 outputs 0 < k < fc max . Then, f(k'x e ) < max{4^, k'6} 
for any k < k' < fc max . 

(3) If Algorithm 2 does not fail, then the output k satisfies f(kx e ) > (1 — e)kO. 

(4) Letk m = min{fc | f{kx e ) > 0}. Then, Algorithm 2 runs in log ^ max ^ e j • 
log k max ) time. If no such /c m i n exists, then Algorithm 2 runs in 0(log k m ax ) 
time. 

Proof (1) Let H := {(1 - e) s /(*maxX e ) : s G Z+, (1 - e) s f(k ma . x Xe) > 0-~ 
e ) f (k m i n Xe)}■ Let h* be the (unique) element in H such that h* < f{k*x e ) < 

Let k be the minimum integer such that f(kx e ) > h*. Then, k < k* 

and f(k*x e ) < ■ Thus kd < k*0 < f(k*x e ) < ; which means that 

(1 - e)k0 < f(kx e ). 

(2) Let h and h! be the unique elements in H such that h < f{kx e ) < yzy 

and h! < f(k'x e ) < respectively. Note that h < h'. If h = h! then 
f(k'x e ) < ■ If h < h!, let k\ be the minimum k\ such that f{k\X e ) > h'. 

Then < 9, where the last inequality follows from the fact 

that A* is examined by the algorithm before k. 

(3) and (4) are obvious. □ 

Our algorithm for maximizing monotone lattice submodular functions un¬ 
der a cardinality constraint is based on the decreasing threshold greedy frame¬ 
work and uses Algorithm 2 to find elements whose marginal gain is as large as 
the current threshold. The pseudocode description is shown in Algorithm 3. 

Let 9i be 9 in the i-th iteration of the outer loop. Let fci je be k when han¬ 
dling e G E in the i-th iteration of the outer loop. Let y i e be the vector y right 
before adding the vector fcq e Xe- Tor notational simplicity, we define y Q e = 0 
and ko^ e = 0 for all e G E. Let Aq e = (a;* — y t e ) V 0. The following lemma 
shows that /(A^ e (a)x Q | y ie ) < A i>e (a)9i for any iGN and e,a G E, which 
is a crucial property to guarantee the approximation ratio of Algorithm 3, 
except that there are several small error terms. 

Lemma 5 For any i G N and e,a G E, 

C € O ' 

f(A i>e (a)x a I Vi,e) < “axjj— ~f(h-l,aXa I Vi- l,a)> (^-l,«+4i,e(a))j^}. 
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Proof We define A = A i>e , k! = i )0 , y = y i>a , y' = y^^, and 9' = j±- e 

for notational simplicity. We assume A{a) >0 as otherwise the statement is 
trivial. When i > 2, from (2) in Lemma 4, 

/((*' + A(a))x a I y') < max { /(A i x !|^ /) 1 ( k ' + A ( a )) e 'Y 

We can verify that this inequality also holds when i = 1 because 

/(O' + A (a))x a I y') = f( A ( a )x a ) < tax < O' + A (a))9'. 

Since /(O' + A (a))x a I y') > f( A (a)x a I y) + /O'Xo I y') holds from 
lattice submodularity, it follows that 

f( A (a)x a I y) < max { Y^/O'xa I y'). (*' + A (°-)W - f( k 'x a I y')}- 

Since f(k'x a I v') > (1 — e)k'9' from (1) of Lemma 4, we obtain the claim. □ 


Lemma 6 


/ ( k i,eXe I y^.e) > 


(1 - efkj^e 
(1 + e)r 


(51 f( A i,e(a)Xa I Vi,e ) 

aGE 



Proof Note that for any i e N and e € E, f{ki te x e I Vi, e ) > (1 — e)ki, e 9i 
from (1) of Lemma 4. Hence, by summing up the inequalities of Lemma 5 over 
all a £ E, we obtain 


55 f( A i,e( a )Xa I y*,e) 

aeE 

_^ 0 . _^ £ 

< 55 ( A-l,a + A,e(o)) + 55 Y~e^ kl ~ 1,aXa I y *-La) 

< (! + ^ r Y~ + T ~J^ y ^ 

- (/it, 1 »•.■> + 

We obtain the claim by rearranging the inequality. □ 


Theorem 2 Algorithm 3 achieves an approximation ratio of 1 — - — O(e) in 


0 (^ 3 - log ||c||oo log | log r) time, where t = 


_max e gE f(c(e)xA _ 

min {/(Xel a: ) :e 6 £; . 0 < :c < c ./(Xel :,: )> 0 } ' 


Proof Let y be the final output of Algorithm 3. We can assume that y{E) = 
r. To see this, consider the modified algorithm in which 9 is updated until 
y(E) = r. The output y' of this modified algorithm satisfies y'(E) = y. 
By a similar argument as above, we can show that ]P agE /((y' - y){a)x a I 
y) < (1 + e)r^ + yzj/(y), where 6» min = fd max . This yields /(y') < (1 + 
0(e))/(y) + 0(e)0PT. Hence it suffices to show that y' gives (1 — 1/e — e)- 
approximation. 
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Let a = 


(i-O 2 

l+e 


and 


. By Lemma 6 and lattice submodularity of /, 


f{h,eXe I Vi,e) > 



(51 f( A he{a)Xa I Vi,e) - Pf(yi,ei) 

a£E 


> ((/(** V 2/i,e) - f(Vi,e )) - Pf{Vi,<S) 

>^e(0 pT _( 1 + /3) /(y . e )) 

= a(l + 0 )-^- (OPT — /(j/j )6 )) 


(1 - Q(e))fci, e 
r 


(opt — , 


where OPT = OPT/(l + /3) = (1 — e)OPT. By the same argument in the case 
of DR-submodular functions, we can show that f[y) > (1 — 1/e — 0(e))0PT = 
(1 — 1/e — 0(e))0PT. The analysis of the time complexity is straightforward. 
□ 


4 Polymatroid Constraint 

Let P be a polymatroid with a ground set Li and the rank function p : 2 s —> 
Z_|_. The objective is to maximize f(x) subject to x £ P 0 Z E , where / is a 
DR-submodular function. In what follows, we denote p(E) by r. We assume 
that P is contained in the interval [0, c] := {x £ R+ : 0 < x < c}. 

We start by describing a continuous extension for polymatroid constraints 
in Section 4.1 and then state and analyze our algorithm in Section 4.2. 


4.1 Continuous extension for polymatroid constraints 

For x £ R E , let |_®J denote the vector obtained by rounding down each entry 
of x. For a £ R, let (a) denote the fractional part of a, that is, (a) := a — [aj- 
For x £ R b , we define C(x) := {y £ M. E \ \x\ < y < L®J + 1} as the 
hypercube to which x belongs. 

For x £ R e , we define T>(x) as the distribution from which we sample 
x such that x(i) = [a;(*)J with probability 1 — (x(i)) and x{i) = [*(*)] 
with probability (x(i)), for each i £ E. We define the continuous extension 
F : R+ —»• R+ of / : Z E —> R + as follows. For each x £ R+, we define 

f{x) ■= e [f(x )\=55 /(l*j+ xs) na- (*(*)))• ( i ) 

SCB ies iis 

We call this type of continuous extension the continuous extension for polyma¬ 
troid constraints. Note that F is obtained by gluing the multilinear extension 
of / restricted to each hypercube. If / : {0,1}^ —>• R + is a monotone sub- 
modular function, it is known that its multilinear extension is monotone and 
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concave along non-negative directions. We can show similar properties for the 
continuous extension of a function / : Z® —» K + if / is monotone and DR- 
submodular. 


Lemma 7 For a monotone DR-submodular function f, the continuous exten¬ 
sion F for the polymatroid constraint is a non-decreasing concave function 
along any line of direction d > 0. 


To prove this, we need the following useful fact from convex analysis. 


Lemma 8 (Rockafellar [23], Theorem 24.2) Let g : R —> R be a non¬ 
increasing function and a£l. Then 

f{x) := f g(t)dt 

J a 

is a concave function. 


We will use the following notation from [23]; For a function <f> : K. —1 R and 
a G R, let us define 


(p' + (a) 


e^O 6 


and 


< t>_(a) := lim 

efO 


(j)(a + e) — cj>(a) 
e 


if the limits exist. For a multivariate function F : R E —> R, V+F and V_F 
are defined in a similar manner. For i G E, the i-th entry of V+F 1 equals (p' + 
where <j> = and V-F is defined accordingly. 

Proof (of Lemma 1) Let p G R^ and <^(£) := f(p + fd) for £ > 0. To show 
that <j> is a non-decreasing concave function, we will find a non-increasing 
non-negative function g such that </>(£) = </>(0) + J(( g(t)dt. Note that if <j> is 
differentiable for all £ > 0, then g := <f>' satisfies the condition. However, <f> 
may be non-differentiable at £ if P + £d contains an integral entry. 

Let us denote x := p + f Q d and suppose that Xi G Z for some i. Then one 
can check that </>'_(£o) = (VFL|£ 0 ) T <f and cf + (^o) = (VF+|^ 0 ) T d. For each j, 


Vi? -0’)l«o = Y f&i I L^J - Xi + Xs) n<*0-)) n (!-( x (j)))> 

Stilus jes 

VF + (j )| 4o = f(Xi I L*l + Xs) n<*0-)) II ~ ( x (j)))' 

S:i£S jeS 

On the other hand, from DR-submodularity, 


f(Xi I L x \ - Xi + Xs) > f(Xi I [ x \ + Xs)- 

Since d > 0 , we have </>'_(£o) > </>+(£o)- 

Let g : R + — > R be an arbitrary function such that </>'_(£) > <?(£) > </>[,(£) 
for £ > 0. Note that g(£) = <j>'(£) if 4> is differentiable at £. Then g is non¬ 
decreasing and non-negative. Since g(£) = almost everywhere, </>(£) = 

</>(0) + Jq g(t)dt. The lemma now directly follows from the non-negativity of g 
and Lemma 8. □ 
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Algorithm 4 Polymatroid Constraint/DR-Submodular 
Input: / : "L+ —» K+, P C R^, and e > 0. 

Output: A vector i£Pfl Z?. 

1 : x° «- 0 . 

2: for (t t— 1; t < [7]; 1 ■£- t + 1) do 
3: j/ 4 <— Direction Polymatroid (/, a: t_1 , e, P). 

4 : a: 4 ■(— £E t_1 + ej/. 

5: a; <— RoundingPolymatroid(a; 1 / <! , P). 

6: return a;. 


Algorithm 5 DirectionPolymatroid(/, x, e, P) 

Input: / : — > R_|_, x £ R+, e 6 [0,1], P C R^. 

Output: A vector y £ P n Z+. 

1 : ?/ t- 0 and d, <— max eeB /(xj. 

2: N ■£- the solution to N = n[l°gi/i_ e Note that TV = 0(^ log ^). 
3: for (0 = d; 0 > 9 £- 0(1 - e)) do 

4: for all e £ E do 

5: fcmax <- max{fc : a: + y + fcx e S P}. 

6 : k <— BinarySearchPolymatroid(/, x, e, 0, erg, /3g, 65 , fcmax)- 

7: if k > 1 then 

8 : y^y + kxe- 

9: return y. 


For a continuous extension F for polymatroid constraints and x,y £ R E , 
we define F( x \ y) = F(x + y) — F(y). The following is immediate. 

Proposition 1 If x £ Z+, then F(x \ y) = E z ^v( y )[f{x \ z )]. 


4.2 Continuous greedy algorithm for polymatroid constraints 

In this section, we describe and analyze our algorithm for the polymatroid 
constraint, whose pseudocode description is presented in Algorithm 4. 

At a high level, our algorithm computes a sequence x° = 0,..., x 1 / e in 
P (recall that we have assumed that 1/e is an integer). For each time step 
t £ [l/e]> given x t_1 , we determine a direction y* by calling a subroutine 
DirectionPolymatroid, and we update as x* := x t_1 + ey* . Intuitively speak¬ 
ing, y l is the direction that maximizes the marginal gain while keeping x t in 
P. Finally, we execute a rounding algorithm RoundingPolymatroid to the frac¬ 
tional solution x 1 / 6 , and obtain an integral solution x. The detailed description 
on DirectionPolymatroid and RoundingPolymatroid are given in Sections 4.2.1 
and 4.2.2, respectively. 

4-2.1 Computing an approximation to the gradient 

As mentioned above, given a vector x £ P, we want to compute a direction 
y that maximizes the marginal gain F(ey | x) and satisfies x+ey £ P. In order 
to efficiently approximate such y, again we use the decreasing-threshold greedy 
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Algorithm 6 BinarySearchPolymatroid(/, a?, e, 6 , a, /?, /c max ) 

Input: / : Z+ -> R+, a: £ R+, e £ E, 0 £ R+, a £ (0,1/2), /3, <5 £ (0,1), /c m ax E Z_|_ 
Output: /c £ Z_(_. 

1: £ <— 1, U i — fcmax- 

2 : while £ < u do 
3: m= L^J- 

4: F(mx e \ x) <— the estimate of F(mx e \ x) obtained by averaging O 

random samples. 

5: if F(mx e \ x) > mO then 

6: £ <— m + 1. 


7 : else 

8 : u <— m. 


9 

10 


k <-£- 1. 

return /c. 


framework. The pseudocode of DirectionPolymatroid is given in Algorithm 5. 
The parameters 05 , /3g, and $5 will be determined later. 

Recall that, in the framework, we want to determine how many copies of 
an element can be added when the average marginal gain is restricted to be 
as large as the current threshold. Given x £ Rf, e £ E, and 9 £ R+, Bina- 
rySearchPolymatroid (Algorithm 6 ) performs binary search to find the largest 
k such that F{kx e I x ) > Since we can only estimate the value of F(-) in 
polynomial time, the output k of Algorithm 6 only satisfies the following weak 
conditions: 


Lemma 9 Algorithm 6 satisfies the following properties: 

(1) Suppose that Algorithm 6 outputs k £ Z+. Then, with probability at least 
1-5, 

F(kx e | x) > (1 - a)k9 - Pf{kx e ) 

and 

F((k + l)x e I x) < ^ + + 2fif((k + l)x e ). 

1 — a 

(2) Suppose that Algorithm 6 outputs k £ Z+. Then, with probability at least 
1-5, for any k < k' < fc max , 

F{k'x e | x) < -/A + 2^/(fcmaxXe). 

1 — a 

(3) Algorithm 6 runs in 0(log/c max • Xo &( k ™^/ 5 ) ) time. 

Proof (1) For k £ Z, let s m = F(mx e I x) = E z ~v(*)[f{mXe I z )\ and be 
its estimation. Note that 0 < f{mx e I z ) < f( m X e ) f° r an Y 21 hr the support 
of T>(x). By Lemma 1 and the union bound, with probability at least 1 — <5, 

| Sm Sm | < as m + fifimXe)- 

for every estimation in the process. In what follows, we suppose this happens. 
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Suppose s m < j^{rn9 — Pf(rnx e ))- Then, s m < m9 and we reach Line 8. 
On the other hand, Suppose s m > (m9 + /3f(mx e ))- Then, s m > m9 and 

we reach Line 6. Hence after the while loop, 


Si-1 > 


Si < 


1 

1 ot 
1 

1 — a 


((£ - 1)9 - /3/((£ - l) Xe )) > (1 - a)(e - 1)9 - - l) Xe ) 

{£9 + pf(lXe)) = + 2/3 f(£ X e), 


where the last inequality uses the fact that a < 1/2. Hence, we obtain (1), (2) 
holds due to (1) and the concavity of F, and (3) is obvious. □ 


Lemma 10 Let x* be an optimal solution. DirectionPolymatroid(f, x , e, P) pro¬ 
duces a vector y € R? such that x' := x + y satisfies 


F{x') - F{x) > e((l - 5e)/(®*) - F[x')) 


with probability at least 1 — e/3. 

Proof We choose ag = e, /3g = 2 jv(n+i ) 1 an< ^ % = 37 v - With probability at 
least 1 — e/3, all the binary searches succeed. In what follows, we assume that 
this has happened. Assume for now that DirectionPolymatroid returns y with 
y(E) = r. If not, we add dummy elements of value 0 so that y(E) = r. 

Let y i be the vector y after the i-tli update in the execution of Direc¬ 
tionPolymatroid. We define y 0 = 0. Let bi and fc,; be the element of E and 
the step size chosen in the i-th update, respectively; i.e., y, = y i _ 1 + kiX & 4 - 
Applying Lemma 2 to y and x*, we obtain a mapping <j >: I(y) —> supp + (a:*). 
Let e*j := yj_i( 6 j) + j) for j = 1,..., fa. Then, by construction, y i _ 1 - 
Xbi + Xeij e P for j = 1,..., fa. 

For each i G N, let fa be the threshold used in the t-th update and let 
Xi = x + y.j . By (1) of Lemma 9, 

F(kiX bi I i) > (1 - e)fafa - /3 5 f(kiX bi ) - (2) 

where the last term comes from the case that bi is a dummy element. 

For each t e N and e G E, we define k* e G Z + as the number of the 
occurrence of e in the sequence e* 1 ,..., e* k .. When the vector kiX bi is added, 
any e G E has been a candidate element when the threshold was (This is 
a valid argument only when i > 1. We consider the case of i = 1 presently). 
Thus by (2) of Lemma 9, for each e G E, 

HKeXe I Xi- 1 ) < ^^2 + 2 /35/( fc maxA e )- 
This inequality also holds when i = 1 because F{k* e x e I *»-i) = F{k* e x e ) < 

K* d <K e 9 1 - 
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Rephrasing the inequality yields 

Or > i -^ 1 (F(kl eXe | ®i-i) - 2 / 3 5 /(fc maxXe )). 

By averaging over e € E, we have 

E I ®i-i) - 2 /? 5 /(fc max x e )) • ( 3 ) 

4 e 

Combining (2), (3), and the fact that f(x*) > d, we obtain 

F(hx bi I *»-i) 

> (1 -e) 3 E( F ( fc *>^ I *<-!) “ 2 /%/(fc max x e )) -Phf{hx bi ) - 

e 

= (! -e) 3 E F ^>Xe I *»-l) -^(fihXbJ + E-^( fcm axXe)) “ ^ 

e e 

> (1 -e) 3 E F ^>^e I *i-i) - 2 ^ 5 (/(**) + E/( a3 *)) - ^ 

e e 

> (! - e ) 3 E F ( k teXe I *»-l) - 

e 

Since F is concave along non-negative directions, for any e > 0, 

F(ekiX bi I ®i-i) > e(l - e) 3 E F ( k i,eX e I *»-i) - ( 4 ) 

e 

Using the above inequality and the fact that AT is an upper bound on the total 
number of updates, we bound the improvement at each time step as follows: 


F(x') - F(x) = £(P(x + eyi) - F(x + ey^)) = E F ( ek iX bi I ®*-i) 

i i 

> E ( 1 £ ( 1 “ e ) 3 E F ( k teXe I Xi-l) - ^-/(x*)) (By ( 4 )) 

i V e&E / 


=«(i-«)*EE 


eeE' 


E [f(z + k* e Xe) - f(z)} - 

^D(xi—x) 


E 


2 F 

~N 


/(**) 


> e(l — e) 3 E [/(-s V x*) — f(z)] — 2e 2 f(x*) (from DR-submodularity) 

z~'D(a3 / ) 

> e^(l — e) 3 (/( x*) — F{x')) — 2ef(x*)j. (from monotonicity) 

> e ((l — §e)f(x*) “ F(x')j . 


□ 


Lemma 11 DirectionPolymatroid runs in time log — logr log —). 





18 


Tasuku Soma, Yuichi Yoshida 


Proof Algorithm 6 takes 0(^ log r log ^j-) time. The outer loop iterates 0(| log f) 
times, while the inner loop contains the execution of Algorithm 6 n times. □ 

Lemma 12 At the end of Algorithm f, F(x) > (1 — 1/e — 0(e))OPT with 
probability at least 2/3. Moreover the time complexity is log ^ log r). 

Proof Define 17 := (1 — 5 e)f(x*) = (1 — 5e)OPT. Let x* be the variable x 
after the f-th update. Substituting this into the result of Lemma 10, for any 
t 6 [1/e], we obtain 


Fix*) - Fix*- 1 ) > e(J7 - Fix*)). 
Rephrasing the equation, we have 


17 — Fix*) < 


Q-Fix*- 1 ) 

1+1 


Now applying induction to this equation, we obtain 17 — Fix*) < 17/(1 + e)*. 
Substituting t = 1/e and rewriting the equation we get the desired approxi¬ 
mation ratio: 


Fix) > 



(1 + e) 1 /' 


17 > (1 


i)(l - 5e)OPT = (l - i - 0(e))0PT. 


By Lemma 11, the total time complexity is 0( IL -w- log — log r log —) = 
0 (yr log 3 J log 2 r). □ 


4-2.2 Rounding 

We need a rounding procedure that takes a real vector x 1 / e as the input 
and returns an integral vector x such that E [fix )] > Fix 1 / e ). There are 
several rounding algorithms in the {0,1} £ case [6,7]. However, generalizing 
these rounding algorithms over integer lattice is a non-trivial task. Here, we 
show that rounding in the integer lattice can be reduced to rounding in the 
{ 0 , 1 }-® case. 

Suppose that we have a fractional solution x. The following lemma implies 
that we can round x by considering the corresponding matroid polytope. 

Lemma 13 For x £ P, P D Cix) is a translation of a matroid polytope. 

Proof Let us consider a polytope P' := {(z) : z £ P D C(a?)}. We can check 
that P' can be obtained by translating P n Cix ) by — [a:J and restricting 
to [0, 1] B . Therefore, P' = {z £ [0, 1] E : z(X) < p'iX) MX C E}, where 
p'iX) := minvcx{(p — L a: J)(^ r ) + 1(-® \5^)}. Then we can show that p' is the 
rank function of a matroid by checking the axiom. □ 
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The independence oracle of the corresponding matroid is simply the in¬ 
dependence oracle of P restricted to C(x). Thus, the pipage rounding algo¬ 
rithm for P' = {(z) : z £ P n C{x 1 / e )} yields an integral solution x with 
E[/(*)] > F(x 1/,e ) in strongly polynomial time. 

Slightly faster rounding can be achieved by swap rounding. Swap round¬ 
ing requires that the given fractional solution x is represented by a convex 
combination of extreme points of the matroid polytope. In our setting, we can 
represent x 1//e as a convex combination of extreme points of PnC(x 1 ^ e ) using 
the algorithm of Cunningham [8]. Then, we run the swap rounding algorithm 
for the convex combination and PC\C(x l ^ e ). The running time of this rounding 
algorithm is dominated by the complexity of finding a convex combination for 
a: 1 / 6 , which is 0(n 8 ) time. Adopting this algorithm as RoundingPolymatroid in 
Algorithm 4, we get the following: 

Theorem 3 Algorithm 4 finds an (1 — 1/e — e)- approximate solution (in ex¬ 
pectation) with probability at least 2/3 in log 3 — log 2 r + n 8 ) time. 


5 Knapsack Constraint 

In this section, we give an efficient approximation algorithm for maximiz¬ 
ing a DR-submodular function over the integer lattice under a knapsack con¬ 
straint. The problem we study is formalized as follows: given a monotone 
DR-submodular function / : Z+ —>• R + , c £ and w £ (0, l] s , we want to 
maximize /( x) subject to 0 < x < c and w T x < 1. 

Our algorithm is twofold. The basic idea is similar to algorithms for car¬ 
dinality constraint: we increase the current solution in a greedy manner using 
the decreasing threshold greedy framework. A difference is that the algorithm 
takes its initial solution as an input, whereas the algorithm for cardinality 
constraints always uses the zero vector as the initial solution. This greedy pro¬ 
cedure is presented in Section 5.1. Obviously, the quality of the output of this 
greedy procedure depends on the choice of the initial solution. Here, we use 
partial enumeration , i.e., we try polynomially many initial solutions and return 
the best one among the outputs of the greedy procedure. This partial enumer¬ 
ation algorithm is described in Section 5.2. The entire algorithm is presented 
in Section 5.3. Thoughout this section, x* denotes an optimal solution. 


5.1 Greedy Procedure with Decreasing Threshold 

Let us fix an initial solution Xq and analyze the behavior of Algorithm 7 
on Xq. Let us call an execution of Line 6 a trial. Let ei and fc,; be the value of 
e and k in the i-th trial. We denote by X{ the tentative solution x following 
the i-th trial. Assume that Algorithm 7 first has not updated the tentative 
solution x in the L-th trial. Equivalently, let L be the minimum number such 
that = xl and £Ci_i < Xi for i = 1,..., L — 1. We consider only such a 
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Algorithm 7 GreedyKnapsack(/, c, it;, xq, e) 

Input: / : Z+ — > R+, c E Z+, m E (0, 1] E , xq E Z^, and e > 0. 

Output: x E Z+ with w T x < 1. 

1: a? <- * 0 , u E- c, d E- max e€£ ^* e y , and iu min E- min eG£ ; w(e). 

2: for (0 = d\ 6 > edw min ] 6 E- 0(1 — e)) do 
3: for all e E E do 

4: Find maximum k < u-(e) — *(e) with f(k\ e \ x) > kw(e)0 with binary search. 

5: if /c > 0 then 

6: if «; T £c + kw(e) < 1 then cc •<— a? + /cx e else -u(e) E- a?(e) + k — 1. {“trial”} 

7: return a?. 


situation, because if this is not the case, then Algorithm 7 outputs a feasible 
solution x satisfying 

OPT — f(x) < f(x V x*) — f(x) < ^2 f(Xe I x ) < ed < eOPT, 

which means that x gives (1 —e)-approximation. Thus we focus on the situation 
in which Algorithm 7 fails to increase the tentative solution. 

Lemma 14 Without loss of generality, we may assume that xl_\ (e_t,) + fcf, < 
x*(e L ). 

Proof Suppose that XL-\(eif) + hi, > x*(cl). Let us consider a modified in¬ 
stance in which c(e/,) is reduced to x^-i (e^) + fcz, — 1. The optimal value is 
unchanged by this modification because x* is still feasible and optimal. Fur¬ 
thermore, Algorithm 7 returns the same solution. Thus, it suffices to analyze 
the algorithm in the modified instance. Repeating this argument completes 
the proof of this lemma. □ 


Lemma 15 For i = 1,..., L, the average gain satisfies the following. 


f{hXe, I 3h-i) > ^ 
kw{ef) 


s f(Xs I x i-i) 

w(s) 


(s € supp + (a;* 


x)) 


Proof The proof is similar to Lemma 3. For the sake of simplicity, let us fix i 
and denote x := Xi_ i, e := et, and k := ki. We first have f{kx e \ x) > kw{e)0. 
Then, we show that f(x s I x ) < for any s £ supp + (cc* — a:). This is 

trivial by DR-submodularity if 9 = d. Thus we assume that 9 < d, i.e., there 
is at least one threshold update. Let s £ {a;*} \ {a;}, k' be the increment in 
the s-th entry in the previous threshold (i.e., y^-), and x' be the variable x 

at the time. Suppose that f(x s I x ) > Tlien f(( k ' + l)x a I *') > f{X s I 

x) + f(k'x s I x ') > + k which contradicts the fact 

that k’ was the largest value with f{k'x s I x ') > k . Eliminating 9 from 
these inequalities completes the proof. □ 
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Lemma 16 Let x be the output of Algorithm 7 with an initial solution Xq. 
Then 


fix) > (l - i - 0(e)) OPT + _ f{kLXeL | XL )_ 

Proof By monotonicity and DR-submodularity, we have 

OPT < f(xi V x*) 

< /(»*) + /(x s I *i-i) 


< /(*i) + 

s£{x*}\{xi} 


W(s) f{kiX ei I X i~ l) 
1 - e hw(ei) 


(5) 


< fix,) + 


1 f(kiX ei \Xj-l) 
1 - e hw(ei) 


(since *»(*) < *) 


for i = 1,..., L. Rearranging the terms, we have 


f( k iX ei I x i- 1) > (1 - e)w(ei)ki (OPT - fix,)). (i = l,...,L) 

Then by induction, we can prove 
L 

0PT “ f( k iXi I X i~ l) 

2 — 1 

L 

< (OPT - f(x 0 )) ]J(1 - (1 - e)w{e j )k j ) 

3 =1 

< (OPT - /(aj 0 )) exp ^-(1 - e) ^ w{e j )k j 

< (OPT - f(x 0 )) exp (-1 + e) (since Ey=i w i e o)^o > 1) 

< (OPT -/(*„)) (i + 0(e)). 

By monotonicity, 

/(*) > f(x L ) 

L 

= fix o) + y] fihXe, I *»-l) - fi^LXe L I *L-l) 

2=1 

> (i-I-0(e))0PT+=^-/(fc LXei |*l-i), 


which completes the proof. □ 
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Algorithm 8 PartialEnumeration(/, c, w, e) 

Input: / : Z+ —> R_|_, c G Z+, m G (0, l] s , and e > 0. 

Output: A set A consisting of xo G Z+ with |supp(®)| < 3 and w'x o < 1. 
1: A <- 0. 

2: for each ordered tuple A consisting of at most three elements in E do 
3: y {0} 

4: for 2 = 1, ..., |X| do 

5: Let e be the z-th element of X. 

6: y <— lncreaseSupport(/, w, e, y, e). 

7: X <— X U {x G 3^ : w T x < 1}. 

8 : return A. 


Algorithm 9 lncreaseSupport(/, c, e, 3^ e) 

Input: / : Z+ —»• M_|_, c G Z+, m G (0, 1] E , e G E, 3^ Q Z+, and e > 0. 

Output: A set X. 

1: A <- 0. 

2: for y £ y do 

3: Find k m i n with 0 < fc m i n < c(e) such that f(k m inXe | 2 /) > 0 by binary search. 

4: if no such k min exists then continue. 

5: for (h = f(c(e)x e I y)\ h > (1 - e)/(fc min X e I v)\ h = (1 ~ do 

6: Find the smallest k with k m [ n < fc < c(e) such that f{kx e ) > h by binary search. 

7: Add y + k\e to X. 

8: return A. 


5.2 Partial Enumeration 

We now prove that the greedy procedure returns a (1 — l/e)-approximate 
solution for some Xq and that such Xq can be found in polynomial time. Here, 
we exploit partial enumeration technique. The pseudocode description of our 
algorithm is shown in Algorithm 8 . 

Lemma 17 There exists Xq in the output of PartialEnumeration such that 
f{kLXe L I X L-1 ) < 3 p~rj; where i, Ul, and ez, are defined as above 
for Algorithm 7 with the initial solution Xq. 

Proof In what follows, we assume that n > 3 for simplicity . 2 For a function 
g : —>• R + and an element e G E, we define 

H(g, e) := {(1 - e) s g(c(e)Xe) : s G Z+, (1 - e) s g(c{e)x e ) > g(k minX e )}, 

where fc m in is the minimum k G Z + such that g(kx e ) > 0. Let us define h(g, e) 
to be the unique element in H(g,e) with h{g,e) < g(x*{e)x e ) < and 

l(g,e) to be the minimum integer such that g(l{g,e)x e ) — h{g,e). 

Then we define el, e\, G E as follows: 

fi ■= f, e* G argmax egB /i(a;*(e)x e ), h ~ l{h,e\) 

Si '■= /(• I e* G argmax eeB /i(x*(e)x e ), h := /(/,;, e*) (i = 2,3). 


2 If n < 3, by a similar argument, one can show that there exists xq in the output of 
PartialEnumeration that attains (1 — e)-approximation. 
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Let us define x 0 := J2i-i hXe* ■ Note that x 0 is an element of the output of 
PartialEnumeration. By the definition, we have 


fihXe* I Vj-iijXej) < /(®*(e*)Xe: I I V£\hX e -)- 

for i = 1,2, 3. We now show this Xq satisfies the required condition. We have 


f( k LXe L I x l- 1) < f( x *(e L )x eL v X L- 1 ) ~ f( x L-i) (by Lemma 14) 

< f( x *(eL)Xe L V 0 ) — /( 0 ) (by weak diminishing return) 

< f(x*(ei)Xei) (by the definition of e*) 

< Yz-J(hXei)- 

Similarly, applying weak diminishing return with l\X e * instead of 0, we obtain 

f{ k LXe L I XL- 1) < f(x*(el)Xel I hXe*) < J^—JihXe- I hXe*)' 

In the same way, we have 

tt k LXe L I XL- 1) < Y^-JihXe- I VZ 2 X e *)- 

Adding these inequalities, we obtain 3 f{kLXe L I ®l-i) > f(x o)/(l — e). □ 


5.3 Final Algorithm 

Our final algorithm for maximizing a montone DR-submodular function sub¬ 
ject to a knapsack constraint is shown in Algorithm 10. 


Algorithm 10 Knapsack Constraint/DR-Submodular 
Input: / : Z+ —>• R+, c G Z+, in G (0, l] s , and e > 0. 

Output: a: G Z+. 

1: A? «— PartialEnumeration(/, c, w, e), Q <— 0. 

2: for each a?o E X do 

3: y <— GreedyKnapsack(/, c, w, a?o, e) 

4: Add y to 

5: x <— argmax yGg /(y). 

6: return a? 


Theorem 4 Algorithm 10 finds a (1 — 1/e — 0{e))~ approximate solution in 


O — log 3 r 


, 1 1 , ,1 n , „ „ 1 

log C oo + -log C oolog- 

e eWmin 


time where t = _ max egE /(c( e ) x J _ 

’ min{f(X e \n):e£E,0<x<c,f(x e \x)>0} 

0 < e < 1 — e/3. 


, Wmin = mm e<£E w(e), and 
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Proof Let Xq be the element in the output of PartialEnumeration described in 
Lemma 17 and xl_\ be the corresponding variable for GreedyKnapsack with 
the initial solution Xq. By Lemmas 16 and 17, 

f{x L - 1 ) > (l-i-0(e))0PT+(i 

> (l---0(e))0PT. 

For the running time, PartialEnumeration finds 0(yr log 3 t) initial solutions 

3 o o 

in 0(^3 log ||c||oo log t) time. For each initial solution, GreedyKnapsack takes 
0(j log ||c||oo log 1 ) time. Thus the total running time of Algorithm 10 is 

as claimed. □ 


3(1-e) 


)/(y 0 ) 
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